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METHODS AND APPARATUS FOR IMPLEMENTING 
VIRTUALIZATION OF STORAGE WITHIN A STORAGE 
AREA NETWORK THROUGH A VIRTUAL ENCLOSURE 

5 BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to network technology. More particularly, 
the present invention relates to methods and apparatus for supporting 
virtualization of storage within a storage area network. 

10 2. Description of the Related Art 

In recent years, the capacity of storage devices has not increased as fast as the 
demand for storage. Therefore a given server or other host must access multiple, 
physically distinct storage nodes (typically disks). In order to solve these storage 
limitations, the storage area network (SAN) was developed. Generally, a storage area 
15 network is a high-speed special-purpose network that interconnects different data 
storage devices and associated data hosts on behalf of a larger network of users. 
However, although a SAN enables a storage device to be configured for use by 
various network devices and/or entities within a network, data storage needs are often 
dynamic rather than static. 

20 

FIG. 1 A illustrates an exemplary conventional storage area network. More 
specifically, within a storage area network 102, it is possible to couple a set of hosts 
(e.g., servers or workstations) 104, 106, 108 to a pool of storage devices (e.g., disks). 
In SCSI parlance, the hosts may be viewed as "initiators" and the storage devices may 

25 be viewed as "targets." A storage pool may be implemented, for example, through a 
set of storage arrays or disk arrays 1 10, 1 12, 1 14. Each disk array 1 10, 112, 1 14 
further corresponds to a set of disks. In this example, first disk array 1 10 corresponds 
to disks 116, 118, second disk array 112 corresponds to disk 120, and third disk array 
114 corresponds to disks 122, 124. Rather than enabling all hosts 104-108 to access 

30 all disks 1 16-124, it is desirable to enable the dynamic and invisible allocation of 
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storage (e.g., disks) to each of the hosts 104-108 via the disk arrays 1 10, 1 12, 1 14. In 
other words, physical memory (e.g., physical disks) may be allocated through the 
concept of virtual memory (e.g., virtual disks). This allows one to connect 
heterogeneous initiators to a distributed, heterogeneous set of targets (storage pool) in 
5 a manner enabling the dynamic and transparent allocation of storage. 

The concept of virtual memory has traditionally been used to enable physical 
memory to be virtualized through the translation between physical addresses in 
physical memory and virtual addresses in virtual memory. Recently, the concept of 

10 "virtualization" has been implemented in storage area networks through various 

mechanisms. Virtualization intercon verts physical storage and virtual storage on a 
storage network. The hosts (initiators) see virtual disks as targets. The virtual disks 
represent available physical storage in a defined but somewhat flexible manner. 
Virtualization provides hosts with a representation of available physical storage that is 

1 5 not constrained by certain physical arrangements/allocation of the storage. 

One early technique, Redundant Array of Independent Disks (RAID), provides 
some limited features of virtualization. Various RAID subtypes have been 
implemented. In RAID1, a virtual disk may correspond to two physical disks 116, 

20 118 which both store the same data (or otherwise support recovery of the same data), 
thereby enabling redundancy to be supported within a storage area network. In 
RAID0, a single virtual disk is striped across multiple physical disks. Some other 
types of virtualization include concatenation, sparing, etc. Some aspects of 
virtualization have recently been achieved through implementing the virtualization 

25 function in various locations within the storage area network. Three such locations 
have gained some level of acceptance: virtualization in the hosts (e.g., 104-108), 
virtualization in the disk arrays or storage arrays (e.g., 1 10-1 14), and virtualization in 
a storage appliance 126 separate from the hosts and storage pool. Unfortunately, each 
of these implementation schemes has undesirable performance limitations. 

30 



Virtualization in the storage array is one of the most common storage 
virtualization solutions in use today. Through this approach, virtual volumes are 
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created over the storage space of a specific storage subsystem (e.g., disk array). 
Creating virtual volumes at the storage subsystem level provides host independence, 
since virtualization of the storage pool is invisible to the hosts. In addition, 
virtualization at the storage system level enables optimization of memory access and 
5 therefore high performance. However, such a virtualization scheme typically will 
allow a uniform management structure only for a homogenous storage environment 
and even then only with limited flexibility. Further, since virtualization is performed 
at the storage subsystem level, the physical-virtual limitations set at the storage 
subsystem level are imposed on all hosts in the storage area network. Moreover, each 
10 storage subsystem (or disk array) is managed independently. Virtualization at the 
storage level therefore rarely allows a virtual volume to span over multiple storage 
subsystems (e.g., disk arrays), thus limiting the scalability of the storage-based 
approach. 

15 When virtualization is implemented on each host, it is possible to span 

multiple storage subsystems (e.g., disk arrays). A host-based approach has an 
additional advantage, in that a limitation on one host does not impact the operation of 
other hosts in a storage area network. However, virtualization at the host-level 
requires the existence of a software layer running on each host (e.g., server) that 

20 implements the virtualization function. Running this software therefore impacts the 
performance of the hosts running this software. Another key difficulty with this 
method is that it assumes a prior partitioning of the available storage to the various 
hosts. Since such partitioning is supported at the host-level and the virtualization 
function of each host is performed independently of the other hosts in the storage area 

25 network, it is difficult to coordinate storage access across the hosts. The host-based 
approach therefore fails to provide an adequate level of security. Due to this security 
limitation, it is difficult to implement a variety of redundancy schemes such as RAID 
which require the "locking" of memory during read and write operations. In addition, 
when mirroring is performed, the host must replicate the data multiple times, 

30 increasing its input-output and CPU load, and increasing the traffic over the SAN. 
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Virtualization in a storage area network appliance placed between the hosts 
and the storage solves some of the difficulties of the host-based and storage-based 
approaches. The storage appliance globally manages the mapping and allocation of 
physical storage to virtual volumes. Typically, the storage appliance manages a 
5 central table that provides the current mapping of physical to virtual. Thus, the 
storage appliance-based approach enables the virtual volumes to be implemented 
independently from both the hosts and the storage subsystems on the storage area 
network, thereby providing a higher level of security. Moreover, this approach 
supports virtualization across multiple storage subsystems. The key drawback of 

10 many implementations of this architecture is that every input/output (I/O) of every 
host must be sent through the storage area network appliance, causing significant 
performance degradation and a storage area network bottleneck. This is particularly 
disadvantageous in systems supporting a redundancy scheme such as RAID, since 
data must be mirrored across multiple disks. In another storage appliance-based 

15 approach, the appliance makes sure that all hosts receive the current version of the 
table. Thus, in order to enable the hosts to receive the table from the appliance, a 
software shim from the appliance to the hosts is required, adding to the complexity of 
the system. Moreover, since the software layer is implemented on the host, many of 
the disadvantages of the host-based approach are also present. 

20 In view of the above, it would be desirable if various storage devices or 

portions thereof could be logically and dynamically assigned to various devices 
and/or entities within a network. Moreover, it would be beneficial if such a 
mechanism could be implemented to support the virtualization of storage within a 
SAN without the disadvantages of traditional virtualization approaches. 

25 

SUMMARY OF THE INVENTION 

Methods and apparatus for implementing virtualization of storage in a 
storage area network are disclosed. This is accomplished through the use of one 
or more network devices capable of being placed in a data path between the hosts 
30 and the storage devices. As a result, neither the storage devices nor the hosts 

require additional software or hardware to support storage virtualization. Thus, 
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the present invention is superior to the host based approach, which requires that 
each host be burdened by additional software to implement virtualization 
functionality. Moreover, the present invention enables multiple network devices 
to simultaneously manage the virtualization of various storage devices. 
5 Importantly, switch-based virtualization may be implemented on a per port basis. 
Any number of ports on a switch can manage virtualization of its own traffic. 
This allows a network's virtualization capacity to scale with the number of ports. 
Since there are large numbers of ports in any network system, there will nearly 
always be sufficient bandwidth for virtualization. Accordingly, virtualization of 
10 storage may be achieved without many of the drawbacks present in conventional 
virtualization schemes. 

In accordance with one aspect of the invention, a virtual enclosure is 
created that has one or more virtual enclosure ports and is adapted for 
representing one or more virtual storage units. In other words, the virtual 

15 enclosure serves to "enclose" selected virtual storage units, which may be 
accessed via the virtual enclosure ports. Each of the virtual storage units 
represents one or more physical storage locations on one or more physical storage 
units of the storage area network. In addition, each of the virtual enclosure ports 
of the virtual enclosure is associated with a port of a network device within the 

20 storage area network. An address or identifier is then assigned to each of the 
virtual enclosure ports. For instance, the address or identifier may be a Fibre 
Channel identifier (FCID). Thus, a message (e.g., packet or frame) directed to a 
virtual enclosure port (or its assigned address/identifier) may be handled by the 
port associated with the virtual enclosure port. 

25 In accordance with various embodiments of the invention, a virtual 

enclosure is implemented within a Fibre channel network. Thus, a Node World 
Wide Name (NWWN) is associated with the virtual enclosure. In addition, a Port 
World Wide Name (PWWN) is associated with each virtual enclosure port. 

In accordance with another aspect of the invention, a port of a network 
30 device within the storage area network is instructed to handle messages on behalf 
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of a virtual enclosure port. This may be accomplished in two ways. First, the port 
may be instructed to "bind" itself to the virtual enclosure port. In other words, the 
port acts as the virtual enclosure port, and all messages directed to the virtual 
enclosure port and received by the port are handled by that port. Second, the port 
5 may be instructed to serve as a "trapping port." More particularly, in addition to 
the port that is bound to the virtual enclosure port, one or more additional ports 
may also handle messages they receive that are directed to the virtual enclosure 
port. A trapping port is preferably a port that is directly connected to a host, and 
therefore can track those requests received by it as well as the responses 
10 associated with those requests. Binding and trapping among multiple ports on 
behalf of a single virtual enclosure port is preferably coordinated at a central 
location such as a virtual enclosure server. 

Various network devices may be configured or adapted for performing the 
disclosed virtualization processes. These network devices include, but are not 
15 limited to, servers (e.g., hosts), routers, and switches. Moreover, the functionality 
for the above-mentioned virtualization processes may be implemented in software 
as well as hardware. 

Yet another aspect of the invention pertains to computer program products 
including machine-readable media on which are provided program instructions for 

20 implementing the methods and techniques described above, in whole or in part. 
Any of the methods of this invention may be represented, in whole or in part, as 
program instructions that can be provided on such machine-readable media. In 
addition, the invention pertains to various combinations and arrangements of data 
generated and/or used as described herein. For example, packets and frames 

25 having the format described herein and provided on appropriate media are part of 
this invention. 

These and other features of the present invention will be described in more 
detail below in the detailed description of the invention and in conjunction with 
the following figures. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 A is a block diagram illustrating an exemplary conventional storage 
area network capable of implementing various embodiments of prior art 
virtualization functions. 

5 FIG. IB is a block diagram illustrating an exemplary storage area network 

in which various embodiments of the invention may be implemented. 

FIG. 2 is a block diagram illustrating a virtualization model that may be 
implemented in accordance with various embodiments of the invention. 

FIG. 3 A is a block diagram illustrating an exemplary virtualization switch 
10 in which various embodiments of the present invention may be implemented. 

FIG. 3B is a block diagram illustrating an exemplary standard switch in 
which various embodiments of the present invention may be implemented. 

FIG. 4 is a transaction flow diagram illustrating a conventional method of 
implementing a node world wide name (NWWN) and port world wide name 
1 5 (PWWN) for each SCSI target port. 

FIG. 5 is a block diagram illustrating an exemplary virtual enclosure in 
accordance with one embodiment of the invention. 

FIG. 6 is a diagram illustrating an exemplary system in which a virtual 
enclosure is implemented through the binding of the virtual enclosure ports to 
20 various virtualization ports in accordance with various embodiments of the 
invention. 

FIG. 7 is a process flow diagram illustrating a method of creating a virtual 
enclosure in accordance with various embodiments of the invention. 
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FIG. 8 is a diagram illustrating a conventional fibre channel identifier 
(FCID) that may be associated with a virtual enclosure port in accordance with 
various embodiments of the invention. 

FIG. 9 is a transaction flow diagram illustrating one method of 
5 coordinating virtual enclosure binding and trapping functionality of visualization 
ports in accordance with various embodiments of the invention. 

FIG. 10 is a diagram illustrating an exemplary table that may be 
maintained by a visualization port indicating FCIDs to be handled by the 
visualization port in accordance with various embodiments of the invention. 

10 FIG. 1 1 is a transaction flow diagram illustrating one method of 

establishing communication between a host and one or more visualization poSs 
(e.g., visual enclosure ports, trapping poSs) such that the host can access one or 
more LUNs in accordance with various embodiments of the invention. 

FIG. 12 is a diagram illustrating an exemplary LUN mapping table that 
15 may be used at step 1 128 of FIG. 1 1 to perform LUN mapping. 

FIG. 1 3 is a diagram representing a visual enclosure corresponding to the 
LUN mapping table of FIG. 12. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

20 In the following description, numerous specific details are set foSh in 

order to provide a thorough understanding of the present invention. It will be 
obvious, however, to one skilled in the aS, that the present invention may be 
practiced without some or all of these specific details. In other instances, well 
known process steps have not been described in detail in order not to 

25 unnecessarily obscure the present invention. 

In accordance with various embodiments of the present invention, 
visualization of storage within a storage area network may be implemented 
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through the creation of a virtual enclosure having one or more virtual enclosure 
ports. The virtual enclosure is implemented, in part, by one or more network 
devices, which will be referred to herein as virtualization switches. More 
specifically, a virtualization switch, or more specifically, a virtualization port 
5 within the virtualization switch, may handle messages such as packets or frames 
on behalf of one of the virtual enclosure ports. Thus, embodiments of the 
invention may be applied to a packet or frame directed to a virtual enclosure port, 
as will be described in further detail below. For convenience, the subsequent 
discussion will describe embodiments of the invention with respect to frames. 
10 Switches act on frames and use information about SANs to make switching 
decisions. 

Note that the frames being received and transmitted by a virtualization 
switch possess the frame format specified for a standard protocol such as Ethernet 
or fibre channel. Hence, software and hardware conventionally used to generate 
15 such frames may be employed with this invention. Additional hardware and/or 
software is employed to modify and/or generate frames compatible with the 
standard protocol in accordance with this invention. Those of skill in the art will 
understand how to develop the necessary hardware and software to allow 
virtualization as described below. 

20 Obviously, the appropriate network devices should be configured with the 

appropriate software and/or hardware for performing virtualization functionality. 
Of course, all network devices within the storage area network need not be 
configured with the virtualization functionality. Rather, selected switches and/or 
ports may be configured with or adapted for virtualization functionality. 

25 Similarly, in various embodiments, such virtualization functionality may be 

enabled or disabled through the selection of various modes. Moreover, it may be 
desirable to configure selected ports of network devices as virtualization-capable 
ports capable of performing virtualization, either continuously, or only when in a 
virtualization enabled state. 

30 
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The standard protocol employed in the storage area network (i.e., the 
protocol used to frame the data) will typically, although not necessarily, be 
synonymous with the "type of traffic" carried by the network. As explained 
below, the type of traffic is defined in some encapsulation formats. Examples of 
5 the type of traffic are typically layer 2 or corresponding layer formats such as 
Ethernet, Fibre channel, and InfiniBand. 

As described above, a storage area network (SAN) is a high-speed special- 
purpose network that interconnects different data storage devices with associated 
network hosts (e.g., data servers or end user machines) on behalf of a larger 
10 network of users. A SAN is defined by the physical configuration of the system. 
In other words, those devices in a SAN must be physically interconnected. 

Within a storage area network 131 such as that illustrated in FIG. IB, 
various storage devices 132, 134, 136, 138, 140, and 142 may be implemented, 
which may be homogeneous (e.g., identical device types, sizes, or configurations) 

15 as well as heterogeneous (e.g., different device types, sizes or configurations). 
Data may be read from, as well as written to, various portions of the storage 
devices 132-142 in response to commands sent by hosts 144 and 146. 
Communication among the storage devices and hosts is accomplished by coupling 
the storage devices and hosts together via one or more switches, routers, or other 

20 network nodes configured to perform a switching function. In this example, 

switches 148, 150, and 152 communicate with one another via interswitch links 
154 and 156. 

As indicated above, this invention pertains to "virtualization" in storage 
networks. Unlike prior methods, virtualization in this invention is implemented 

25 through the creation and implementation of a virtual enclosure. This is 

accomplished, in part, through the use of switches or other "interior" network 
nodes of a storage area network to implement the virtual enclosure. Further, the 
virtualization of this invention typically is implemented on a per port basis. In 
other words, a multi-port virtualization switch will have virtualization separately 

30 implemented on one or more of its ports. Individual ports have dedicated logic 
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for handing the virtualization functions for packets or frames handled by the 
individual ports. This allows virtualization processing to scale with the number of 
ports, and provides far greater bandwidth for virtualization than can be provided 
with host based or storage based virtualization schemes. In such prior art 
5 approaches the number of connections between hosts and the network fabric or 
between storage nodes and the network fabric are limited - at least in comparison 
to the number of ports in the network fabric. 

In a specific and preferred embodiment of the invention, the virtualization 
logic is separately implemented at individual ports of a given switch - rather than 

10 having centralized processing for all ports of a switch. This allows the 

virtualization processing capacity to be closely matched with the exact needs of 
the switch (and the virtual enclosure) on a per port basis. If a central processor is 
employed for the entire switch (serving numerous ports), the processor must be 
designed/selected to handle maximum traffic at all ports. For many applications, 

15 this represents extremely high processing requirements and a very large/expensive 
processor. If the central processor is too small, the switch will at times be unable 
to keep up with the switching/virtualization demands of the network. 

Virtualization may take many forms. In general, it may be defined as logic 
or procedures that inter-relate physical storage and virtual storage on a storage 

20 network. Hosts see a representation of available physical storage that is not 

constrained by the physical arrangements or allocations inherent in that storage. 
One example of a physical constraint that is transcended by virtualization includes 
the size and location of constituent physical storage blocks. For example, logical 
units as defined by the Small Computer System Interface (SCSI) standards come 

25 in precise physical sizes (e.g., 36GB and 72GB). Virtualization can represent 

storage in virtual logical units that are smaller or larger than the defined size of a 
physical logical unit. Further, virtualization can present a virtual logical unit 
comprised of regions from two or more different physical logical units, sometimes 
provided on devices from different vendors. Preferably, the virtualization 

30 operations are transparent to at least some network entities (e.g., hosts). 
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In some general ways, virtualization on a storage area network is similar to 
virtual memory on a typical computer system. Virtualization on a network, 
however, brings far greater complexity and far greater flexibility. The complexity 
arises directly from the fact that there are a number of separately interconnected 
5 network nodes. Virtualization must span these nodes. The nodes include hosts, 
storage subsystems, and switches (or comparable network traffic control devices 
such as routers). Often the hosts and/or storage subsystems are heterogeneous, 
being provided by different vendors. The vendors may employ distinctly different 
protocols (standard protocols or proprietary protocols). Thus, in many cases, 
10 virtualization provides the ability to connect heterogeneous initiators (e.g., hosts 
or servers) to a distributed, heterogeneous set of targets (storage subsystems), 
enabling the dynamic and transparent allocation of storage. 

Examples of network specific virtualization operations include the 
following: RAID 0 through RAID 5, concatenation of memory from two or more 

15 distinct logical units of physical memory, sparing (auto-replacement of failed 

physical media), remote mirroring of physical memory, logging information (e.g., 
errors and/or statistics), load balancing among multiple physical memory systems, 
striping (e.g., RAID 0), security measures such as access control algorithms for 
accessing physical memory, resizing of virtual memory blocks, Logical Unit 

20 (LUN) mapping to allow arbitrary LUNs to serve as boot devices, backup of 
physical memory (point in time copying), and the like. These are merely 
examples of virtualization functions. This invention is not limited to this full set 
or any particular subset thereof. 

In some of the discussion herein, the functions of virtualization switches 
25 of this invention are described in terms of the SCSI protocol. This is because 
many storage area networks in commerce run a SCSI protocol to access storage 
sites. Frequently, the storage area network employs fibre channel (FC-PH (ANSI 
X3. 230- 1994, Fibre channel - Physical and Signaling Interface) as a lower level 
protocol and runs IP and SCSI on top of fibre channel. Note that the invention is 
30 not limited to any of these protocols. For example, fibre channel may be replaced 
with Ethernet, Infiniband, and the like. Further the higher level protocols need 
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not include SCSI. For example, this may include SCSI over FC, iSCSI (SCSI 
over IP), parallel SCSI (SCSI over a parallel cable), serial SCSI (SCSI over serial 
cable, and all the other incarnations of SCSI. 

Because SCSI is so widely used in storage area networks, much of the 
5 terminology used herein will be SCSI terminology. The use of SCSI terminology 
(e.g., "initiator" and "target") does not imply that the describe procedure or 
apparatus must employ SCSI. Before going further, it is worth explaining a few 
of the SCSI terms that will be used in this discussion. First an "initiator" is a 
device (usually a host system) that requests an operation to be performed by 

10 another device. Typically, in the context of this document, a host initiator will 
request a read or write operation be performed on a region of virtual or physical 
memory. Next, a "target" is a device that performs an operation requested by an 
initiator. For example, a target physical memory disk will obtain or write data as 
initially requested by a host initiator. Note that while the host initiator may 

15 provide instructions to read from or write to a "virtual" target having a virtual 
address, a virtualization switch of this invention must first convert those 
instructions to a physical target address before instructing the target. 

Targets may be divided into physical or virtual "logical units." These are 
specific devices addressable through the target. For example, a physical storage 
20 subsystem may be organized in a number of distinct logical units. In this 

document, hosts view virtual memory as distinct virtual logical units. Sometimes 
herein, logical units will be referred to as "LUNs." In the SCSI standard, LUN 
refers to a logical unit number. But in common parlance, LUN also refers to the 
logical unit itself. 

25 Central to virtualization is the concept of a "virtualization model." This is 

the way in which physical storage provided on storage subsystems (such as disk 
arrays) is related to a virtual storage seen by hosts or other initiators on a network. 
While the relationship may take many forms and be characterized by various 
terms, a SCSI-based terminology will be used, as indicated above. Thus, the 

30 physical side of the storage area network will be described as a physical LUN. 
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The host side, in turn, sees one or more virtual LUNs, which are virtual 
representations of the physical LUNs. The mapping of physical LUNs to virtual 
LUNs may logically take place over one, two, or more levels. In the end, there is 
a mapping function that can be used by switches of this invention to interconvert 
5 between physical LUN addresses and virtual LUN addresses. 

FIG. 2 is a block diagram illustrating an example of a virtualization model 
that may be implemented within a storage area network in accordance with 
various embodiments of the invention. As shown, the physical storage of the 
storage area network is made up of one or more physical LUNs, shown here as 

10 physical disks 202. Each physical LUN is a device that is capable of containing 
data stored in one or more contiguous blocks which are individually and directly 
accessible. For instance, each block of memory within a physical LUN may be 
represented as a block 204, which may be referred to as a disk unit (DUnit). 

Through a mapping function 206, it is possible to convert physical LUN 

15 addresses associated with physical LUNs 202 to virtual LUN addresses, and vice 
versa. More specifically, as described above, the virtualization and therefore the 
mapping function may take place over one or more levels. For instance, as 
shown, at a first virtualization level, one or more virtual LUNs 208 each 
represents one or more physical LUNs 202, or portions thereof. The physical 

20 LUNs 202 that together make up a single virtual LUN 208 need not be 

contiguous. Similarly, the physical LUNs 202 that are mapped to a virtual LUN 
208 need not be located within a single target. Thus, through virtualization, 
virtual LUNs 208 may be created that represent physical memory located in 
physically distinct targets, which may be from different vendors, and therefore 

25 may support different protocols and types of traffic. 

Although the virtualization model may be implemented with a single 
level, a hierarchical arrangement of any number of levels may be supported by 
various embodiments of the present invention. For instance, as shown, a second 
virtualization level within the virtualization model of FIG. 2 is referred to as a 
30 high-level VLUN or volume 210. Typically, the initiator device "sees" only 

VLUN 210 when accessing data. In accordance with various embodiments of the 
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invention, multiple VLUNs are "enclosed" within a virtual enclosure such that 
only the virtual enclosure may be "seen" by the initiator. In other words, the 
VLUNs enclosed by the virtual enclosure are not visible to the initiator. 

In this example, VLUN 210 is implemented as a "logical" RAID array of 
5 virtual LUNs 208. Moreover, such a virtualization level may be further 

implemented, such as through the use of striping and/or mirroring. In addition, it 
is important to note that it is unnecessary to specify the number of virtualization 
levels to support the mapping function 206. Rather, an arbitrary number of levels 
of virtualization may be supported, for example, through a recursive mapping 
10 function. For instance, various levels of nodes may be built and maintained in a 
tree data structure, linked list, or other suitable data structure that can be 
traversed. 

Each initiator may therefore access physical LUNs via nodes located at 
any of the levels of the hierarchical virtualization model. Nodes within a given 

15 virtualization level of the hierarchical model implemented within a given storage 
area network may be both visible to and accessible to an allowed set of initiators 
(not shown). However, in accordance with various embodiments of the invention, 
these nodes are enclosed in a virtual enclosure, and are therefore no longer visible 
to the allowed set of initiators. Nodes within a particular virtualization level (e.g., 

20 VLUNs) need to be created before functions (e.g., read, write) may be operated 
upon them. This may be accomplished, for example, through a master boot 
record of a particular initiator. In addition, various initiators may be assigned read 
and/or write privileges with respect to particular nodes (e.g., VLUNs) within a 
particular virtualization level. In this manner, a node within a particular 

25 virtualization level may be accessible by selected initiators. 

As described above, various switches within a storage area network may 
be virtualization switches supporting virtualization functionality. FIG. 3A is a 
block diagram illustrating an exemplary virtualization switch in which various 
embodiments of the present invention may be implemented. As shown, data or 
30 messages are received by an intelligent, virtualization port via a bi-directional 
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connector 302. In addition, the virtualization port is adapted for handling 
messages on behalf of a virtual enclosure port, as will be described in further 
detail below. In association with the incoming port, Media Access Control 
(MAC) block 304 is provided, which enables frames of various protocols such as 
5 Ethernet or fibre channel to be received. In addition, a virtualization intercept 

switch 306 determines whether an address specified in an incoming frame pertains 
to access of a virtual storage location of a virtual storage unit representing one or 
more physical storage locations on one or more physical storage units of the 
storage area network. For instance, the virtual storage unit may be a virtual 
10 storage unit (e.g., VLUN) that is enclosed within a virtual enclosure. 

When the virtualization intercept switch 306 determines that the address 
specified in an incoming frame pertains to access of a virtual storage location 
rather than a physical storage location, the frame is processed by a virtualization 
processor 308 capable of performing a mapping function such as that described 

15 above. More particularly, the virtualization processor 308 obtains a virtual- 
physical mapping between the one or more physical storage locations and the 
virtual storage location. In this manner, the virtualization processor 308 may look 
up either a physical or virtual address, as appropriate. For instance, it may be 
necessary to perform a mapping from a physical address to a virtual address or, 

20 alternatively, from a virtual address to one or more physical addresses. 

Once the virtual-physical mapping is obtained, the virtualization processor 
308 may then employ the obtained mapping to either generate a new frame or 
modify the existing frame, thereby enabling the frame to be sent to an initiator or 
a target specified by the virtual-physical mapping. The mapping function may 

25 also specify that the frame needs to be replicated multiple times, such as in the 
case of a mirrored write. More particularly, the source address and/or destination 
addresses are modified as appropriate. For instance, for data from the target, the 
virtualization processor replaces the source address, which was originally the 
physical LUN address with the corresponding virtual LUN and address. In the 

30 destination address, the port replaces its own address with that of the initiator. 

For data from the initiator, the port changes the source address from the initiator's 
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address to the port's own address. It also changes the destination address from the 
virtual LUN/address to the corresponding physical LUN/address. The new or 
modified frame may then be provided to the virtualization intercept switch 306 to 
enable the frame to be sent to its intended destination. 

5 While the virtualization processor 308 obtains and applies the virtual- 

physical mapping, the frame or associated data may be stored in a temporary 
memory location (e.g., buffer) 310. In addition, it may be necessary or desirable 
to store data that is being transmitted or received until it has been confirmed that 
the desired read or write operation has been successfully completed. As one 

10 example, it may be desirable to write a large amount of data to a virtual LUN, 
which must be transmitted separately in multiple frames. It may therefore be 
desirable to temporarily buffer the data until confirmation of receipt of the data is 
received. As another example, it may be desirable to read a large amount of data 
from a virtual LUN, which may be received separately in multiple frames. 

15 Furthermore, this data may be received in an order that is inconsistent with the 

order in which the data should be transmitted to the initiator of the read command. 
In this instance, it may be beneficial to buffer the data prior to transmitting the 
data to the initiator to enable the data to be re-ordered prior to transmission. 
Similarly, it may be desirable to buffer the data in the event that it is becomes 

20 necessary to verify the integrity of the data that has been sent to an initiator (or 
target). 

The new or modified frame is then received by a forwarding engine 312, 
which obtains information from various fields of the frame, such as source 
address and destination address. The forwarding engine 312 then accesses a 
25 forwarding table 3 14 to determine whether the source address has access to the 
specified destination address. More specifically, the forwarding table 314 may 
include physical LUN addresses as well as virtual LUN addresses. The 
forwarding engine 312 also determines the appropriate port of the switch via 
which to send the frame, and generates an appropriate routing tag for the frame. 

30 
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Once the frame is appropriately formatted for transmission, the frame will 
be received by a buffer queuing block 316 prior to transmission. Rather than 
transmitting frames as they are received, it may be desirable to temporarily store 
the frame in a buffer or queue 318. For instance, it may be desirable to 
5 temporarily store a packet based upon Quality of Service in one of a set of queues 
that each correspond to different priority levels. The frame is then transmitted via 
switch fabric 320 to the appropriate port. As shown, the outgoing port has its own 
MAC block 322 and bi-directional connector 324 via which the frame may be 
transmitted. 

10 As described above, all switches in a storage area network need not be 

virtualization switches. In other words, a switch may be a standard switch in 
which none of the ports implement "intelligent," virtualization functionality. FIG. 
3B is a block diagram illustrating an exemplary standard switch in which various 
embodiments of the present invention may be implemented. As shown, a 

15 standard port 326 has a MAC block 304. However, a virtualization intercept 
switch and virtualization processor such as those illustrated in FIG. 3 A are not 
implemented. A frame that is received at the incoming port is merely processed 
by the forwarding engine 312 and its associated forwarding table 314. Prior to 
transmission, a frame may be queued 316 in a buffer or queue 318. Frames are 

20 then forwarded via switch fabric 320 to an outgoing port. As shown, the outgoing 
port also has an associated MAC block 322 and bi-directional connector 324. Of 
course, each port may support a variey of protocols. For instance, the outgoing 
port may be an iSCSI port (i.e. a port that supports SCSI over IP over Ethernet), 
which also supports virtualization, as well as parallel SCSI and serial SCSI. 

25 Although the network devices described above with reference to FIG. 3 A 

and 3B are described as switches, these network devices are merely illustrative. 
Thus, other network devices such as routers may be implemented to receive, 
process, modify and/or generate packets or frames with functionality such as that 
described above for transmission in a storage area network. Moreover, the above- 

30 described network devices are merely illustrative, and therefore other types of 
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network devices may be implemented to perform the disclosed virtualization 
functionality. 

Typically, SCSI targets are directly accessible by SCSI initiators (e.g., hosts). In 
other words, SCSI targets such as PLUNs are visible to the hosts that are 
5 accessing those SCSI targets. Similarly, even when VLUNs are implemented, the 
VLUNs are visible and accessible to the SCSI initiators. Thus, each host must 
typically identify those VLUNs that are available to it. More specifically, the host 
typically determines which SCSI target ports are available to it. The host may 
then ask each of those SCSI target ports which VLUNs are available via those 
10 SCSI target ports. 

Within a Fibre channel network, all Fibre channel devices have a World Wide 
Name (WWN). More specifically, a Node WWN (NWWN) is the WWN of the 
node that is connected to a particular port. In other words, the NWWN is the 
WWN of the system, storage device, or subsystem that is connected to the switch 
1 5 port. In addition to a Node WWN, a Port WWN (PWWN) serves as a given name 
for a particular port. A Fibre channel network ID (FCID) for the particular switch 
port is used to identify the physical location of a port. Each Fibre channel device 
may have multiple ports, each of which is uniquely identified by a NWWN and a 
PWWN. 

20 Unfortunately, there are several disadvantages associated with conventional 

applications of Fibre channel WWN nomenclature. For instance, a NWWN and a 
PWWN must be allocated for each port of a Fibre channel device. However, it 
may be undesirable to allow the NWWN and PWWN of each port to be visible to 
an initiator such as a host. Moreover, the number of available ports is limited to 

25 the number of ports in a particular storage device, subsystem or switch. Similarly, 
the storage device, subsystem or switch may have a greater number of ports than 
are needed in a particular storage virtualization scheme. However, virtualization 
ports are expensive to implement, and it is therefore undesirable to "waste" these 
intelligent ports. Thus, in accordance with the present invention, virtualization 

30 ports may be used on an as-needed basis. In other words, ports may be selected 
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for implementing one or more virtual enclosures, either by binding those ports to 
virtual enclosure ports or by implementing these ports as trapping ports. As a 
result, those ports that are most expensive to produce may be used to their 
maximum capacity. 

5 In one embodiment of the invention, virtual ization in a network such as a 

fibre channel network is implemented without limiting the number of accessible 
ports in a storage subsystem. Moreover, ports within a SAN may selected and 
allocated on an as-needed basis for a particular storage virtualization scheme. 
Various embodiments of the invention are described in further detail below. 

10 In order to understand how the present invention may be applied in a fibre 

channel network, it is helpful to illustrate a conventional application of WWN 
nomenclature in a Fibre channel network. FIG. 4 is a transaction flow diagram 
illustrating a conventional method of implementing a node world wide name 
(NWWN) and port world wide name (PWWN) for each SCSI target port. As 

15 shown, interactions between a host 402, switch 404, Domain Name System 
(DNS) server 406 and SCSI target port 408 are represented by corresponding 
labeled vertical lines. As shown, in order for a fibre channel node such as a host 
402 to establish a logical connection to a fabric switch 404, it performs a fabric 
login (FLOGI) 410. Unlike many LAN technologies that use a fixed Media 

20 Access Control (MAC) address, Fibre channel uses an address identifier, referred 
to as an FCID, which is dynamically assigned during login. Thus, the switch 404 
provides an FCID to the host 402 at 412. Once the host been assigned a host 
FCID, the host may perform a DNS query of a DNS server 406 via a SCSI 
REPORT command, which requests the SCSI targets that are available, and 

25 therefore visible, to the host at block 414. More specifically, the DNS query 

determines those SCSI targets that are visible to the host FCID. The FCID of a 
SCSI target port is then provided by the DNS server 406 to the host 402 at 416. 

Once the host has the FCIDs of those SCSI target ports available to it, it 
sends a Fibre channel process login command to one of the available SCSI target 
30 ports (identified by its FCID) at 418. This process login implements a mapping 
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layer, which "maps" Fibre channel to SCSI. Once completed, the SCSI target port 
408 sends a Fibre channel accept message at 420. Since Fibre channel is mapped 
to SCSI, the host can send SCSI commands to the SCSI target. 

Now that the host 402 can send SCSI commands to the SCSI target port 
5 408, it performs a SCSI process login at 422 by sending a SCSI process login 
command to the SCSI target port 408. The SCSI target port 408 then sends a 
SCSI accept command 424. Communication between the host and the SCSI 
target via the SCSI protocol is therefore established. For instance, the host may 
determine which LUNs are available to it, as well as read and write to those LUNs 
10 available to it. 

Since the host 402 knows which SCSI target ports are available to it and 
can communicate with each of these ports, it can send a SCSI REPORT LUN 
command to the SCSI target port 408 to determine those LUNS that are visible to 
the host FCID at 426. The SCSI target port 408 determines which LUNs are 
15 visible to the host FCED and sends a list of LUNs (e.g., PLUNs or VLUNs) at 428. 
The host 402 may then send SCSI READ and WRITE commands to a particular 
PLUN or VLUN at 430 via the SCSI target port 408. 

In accordance with various embodiments of the invention, storage 
virtualization is implemented in a storage area network through the creation of a 

20 "virtual enclosure." FIG. 5 is a block diagram of an exemplary virtual enclosure 
in accordance with one embodiment of the invention. A virtual enclosure 502 is a 
virtual entity that is that is adapted for "enclosing" or representing one or more 
virtual storage units. For instance, one or more of the virtual storage units may 
each comprise a VLUN or other virtual representation of storage on a SAN. As 

25 described above, each virtual storage unit represents one or more physical storage 
locations on one or more physical storage units 504 of the storage area network. 
Through the creation of a virtual enclosure, various virtualization ports such as 
those described above may be implemented on an as-needed basis to support 
virtualization within a particular storage area network. More specifically, the 

30 virtual enclosure has one or more "virtual enclosure ports," each of which is 
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associated with a port (e.g., visualization port) of a network device within the 
storage area network. For instance, the port of the network device may be 
instructed, either statically or dynamically, to handle messages addressed to the 
virtual enclosure port. An address or identifier is also assigned to each of the 
5 virtual enclosure ports. Thus, a message (e.g., packet or frame) addressed to a 
virtual enclosure port may be identified by this address or identifier, thereby 
enabling a port to intercept and handle messages on behalf of a particular virtual 
enclosure port. For instance, a FCID may be assigned to each of the virtual 
enclosure ports for use in a fibre channel network, or with various fibre channel 
10 devices within a network such as a SAN. In this manner, a virtual enclosure is 
created for representing one or more virtual storage units. 

Within a SAN, it is possible to create different virtual SANs (VSANs). 
One method of implementing virtual storage area networks (VSANs) within a 
single storage area network is described in further detail with reference to U.S. 

15 Patent Application No. , Attorney Docket No. ANDIP001, entitled 

"Methods and Apparatus for Encapsulating a Frame for Transmission in a Storage 
Area Network," Edsall, et al., filed on December 26, 2001, which is incorporated 
herein by reference for all purposes. In other words, it may be desirable or 
necessary to distribute physical storage units among different VSANs. 

20 Accordingly, when the virtual enclosure ports are bound to virtualization ports, 
these selected virtualization ports may be distributed among multiple VSANs. 

Each virtual enclosure may have any number of virtual enclosure ports. In 
other words, it may be desirable to enable the number of virtual enclosure ports to 
be selectable. For instance, a system administrator responsible for creating and 

25 maintaining the virtual enclosure definitions may select the appropriate number of 
virtual enclosure ports. It is important to note that the number of virtual enclosure 
ports within a virtual enclosure is not limited by the number of ports within a 
particular network device within the storage area network. More specifically, 
each virtual enclosure port is associated with a port of a network device within the 

30 storage area network. In other words, the virtual enclosure ports of a single 

virtual enclosure may be simultaneously associated with ports (e.g., virtualization 
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ports) of multiple, different network devices within the storage area network 
rather than a single network device. In addition, a single port of a network device 
such as a virtualization port may be simultaneously associated with or bound to 
multiple virtual enclosure ports. Accordingly, the number of ports that are 
5 available for virtualization of virtual storage units is virtually unlimited. 

As described above, an address or identifier is assigned to each of the 
virtual enclosure ports. Theoretically, this address or identifier may be an address 
or identifier that has been previously assigned to the port of the storage area 
network that is later associated with the virtual enclosure port. However, since a 

10 single virtualization port may be bound to multiple virtual enclosure ports, an 

address or identifier previously assigned to the port (e.g., virtualization port) will 
not uniquely identify a virtual enclosure port. Thus, the address or identifier is 
assigned to the virtual enclosure port to uniquely identify the virtual enclosure 
port. At that time, the address or identifier is provided to the virtualization port 

15 that is associated with the virtual enclosure port. In accordance with one 
embodiment, the virtual enclosure is used in a fibre channel network, and 
therefore each fibre channel device has a NWWN. This nomenclature is 
leveraged in accordance with various embodiments of the invention to enable a 
virtual enclosure to be implemented. Thus, both a NWWN and a PWWN 

20 together may be used as an address or identifier to uniquely identify a virtual 
enclosure port. More particularly, a NWWN is associated with the virtual 
enclosure. In addition, a PWWN is assigned to each virtual enclosure port. The 
NWWN and PWWN together identify the virtual enclosure port until it is 
assigned an address or identifier such as an FCJD. 

25 Once the virtual enclosure is created, one or more virtual storage units may 

be assigned to the virtual enclosure. As described above, each of the virtual 
storage units may be a VLUN or other virtual representation of storage on the 
storage area network. In this manner, the virtual enclosure "encloses" those 
virtual storage units, thereby requiring a host to access those virtual storage units 

30 via the virtual enclosure. In this manner, the VLUNS may be "hidden" from the 
host. In other words, by accessing a PWWN, the host merely has access to the 
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virtual enclosure rather than a specific device or VLUN. More specifically, the 
VLUNs appear as logical units behind a set of virtual enclosure ports. Thus, the 
PLUNs that are used to create the VLUNs are hidden from the host. 

As described above, a storage area network may be implemented with 
5 virtualization switches adapted for implementing virtualization functionality as 
well as standard switches. Each virtualization switch may include one or more 
"intelligent" virtualization ports as well as one or more standard ports. FIG. 6 is a 
diagram illustrating an exemplary system in which a virtual enclosure is 
implemented through the binding of the virtual enclosure ports to various 

10 virtualization ports in accordance with various embodiments of the invention. As 
shown, a virtual enclosure 602 "encloses" two virtual storage units, VLUN1 604 
and VLUN2 606. In this example, the virtual enclosure 602 has three virtual 
enclosure ports, VE1 608, VE2 610, and VE3 612. In addition, four network 
devices within the storage area network are illustrated. More specifically, four 

15 virtualization switches 614, 616, 618, and 620 are illustrated. Each of the 

virtualization switches has one or more virtualization ports as described above 
with reference to FIG. 3A. However, in order to simplify the illustration, each 
virtualization switch is shown to have a single virtualization port, labeled vl, v2, 
v3, and v4, respectively. Each virtualization port has an associated PWWN (not 

20 shown). Communication between the switches may be accomplished by an inter- 
switch link (not shown) between two switches (or two ports). 

Each virtual enclosure port is uniquely identified. More specifically, 
within a fibre channel network, the virtual enclosure 602 is identified by a 
NWWN 621. In addition, once each virtual enclosure port is associated with a 

25 virtualization port, each of the virtual enclosure ports VE1 608, VE2 610, and 

VE3 612 are further identified by a PWWN as well as its FCID, labeled PWWN1 
622, PWWN2 624, and PWWN3 626, respectively. More particularly, the virtual 
enclosure ports may be identified by the NWWN and PWWN until an FCBD is 
assigned to the virtual enclosure ports. An FCID will be further described below 

30 with reference to FIG. 8. As shown, the FCIDs that are assigned also identify the 
virtualization switch associated with the corresponding virtual enclosure port. 
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This is because in Fibre Channel, a switch is seen as a "domain." Thus, the first 
byte of the FCID of any port in that switch is the same as the domain ID. For 
instance, the first byte of the FCID assigned to the first virtual enclosure port VE1 
608 identifies the virtualization switch 616, shown as switch 50. Similarly, the 
5 first byte of the FCID assigned to the second virtual enclosure port VE2 610 

identifies the virtualization switch 614, shown as switch 55, while the first byte of 
the FCID assigned to the third virtual enclosure port VE3 612 identifies the 
virtualization switch 618, shown as switch 45. 

The creation of a virtual enclosure such as virtual enclosure 602 may be 
10 performed by a network device such as a virtual enclosure server 627. The virtual 
enclosure 602 may be created, for example, by a system administrator. Once 
created, various VLUNs such as VLUNs 604 and 606 may be assigned to the 
virtual enclosure 602. Such an assignment may be subsequently modified as 
necessary to include additional VLUNs, remove VLUNs from the virtual 
15 enclosure, or otherwise modify the assignment of VLUNs to the virtual enclosure 
602. In addition to creating , modifying and maintaining a virtual enclosure, the 
virtual enclosure server 627 may also inform the virtualization ports of the 
virtualization switches of their association with the corresponding virtual 
enclosure ports. In this manner, the virtualization ports may be notified of their 
20 responsibility to intercept and handle packets (or frames) directed to those 
corresponding virtual enclosure ports. 

Once a virtual enclosure has been created, one or more hosts 628, 630 may 
access data in the storage area network via the virtual enclosure 602. More 
specifically, the hosts 628, 630 may access various physical storage devices, 

25 referred to as physical storage units, corresponding to the virtual storage units, 
shown here as VLUN1 604 and VLUN2 606. For instance, a host may read data 
from or write data to various PLUNs 632, 634, 636, 638 within the storage area 
network by sending packets, frames or messages to a virtual address within a 
VLUN enclosed by a virtual enclosure (and available to the host via the virtual 

30 enclosure port). 
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As described above, a virtual enclosure may be created for use in a variety 
of network environments. FIG. 7 is a process flow diagram illustrating a method 
of creating a virtual enclosure in accordance with various embodiments of the 
invention. In this example, the virtual enclosure is for use in a Fibre channel 
5 network. Thus, as shown at block 702, a NWWN is associated with the virtual 
enclosure. In addition, the number of virtual enclosure ports of the virtual 
enclosure is selected at block 704. Each of these virtual enclosure ports may be 
identified by a PWWN until they are bound to a virtualization port at block 706 
and assigned an FCID at block 708. Once the virtual enclosure is generated, one 
10 or more VLUNs are assigned to the virtual enclosure at block 710. Thus, when a 
host logs into the SAN at block 712, the host may access physical storage units 
via the virtual enclosure by sending SCSI read and write commands. 

Within a Fibre channel network, each SCSI target device is assigned a 
NWWN. Moreover, each SCSI target port is assigned a PWWN. In addition, a 

15 Fibre channel identifier (FCID) identifies a physical location of each SCSI target 
port, and is therefore associated with the PWWN. FIG. 8 is a diagram illustrating 
a conventional FCID that may be associated with a virtual enclosure port in 
accordance with various embodiments of the invention. A FCID is a three byte 
address identifier, which identifies a switch 802 such as a virtualization switch, an 

20 area 804 within the network, and a port 806 of the switch 802 such as a 
virtualization port. 

As described above, in order to create a virtual enclosure, each virtual 
enclosure port is "bound" to a virtualization port. In accordance with various 
embodiments of the invention, coordination of binding virtual enclosure ports to 

25 virtualization ports is performed by a separate network device. For instance, this 
network device may be the virtual enclosure server responsible for generating a 
virtual enclosure. In other words, the virtual enclosure server instructs a 
virtualization port that it is "bound" to a virtual enclosure port and therefore 
should handle all messages addressed to that virtual enclosure port (that are 

30 received by the virtualization port). 



-26- 



WO 03/060688 



PCT/US02/41079 



In addition to binding a single virtualization port to a virtual enclosure 
port, it may be desirable to enable additional ports to "trap" messages addressed to 
the virtual enclosure port. For instance, a virtualization port receiving a message 
addressed to a virtual enclosure port may be closer to the host than a virtualization 
5 port that is "bound" to the virtual enclosure port, and therefore may be better able 
to provide timely, efficient service. In addition, it may be undesirable to route all 
messages to a single virtualization port that is bound to a virtual enclosure port, 
since this may overload a limited number of ports, resulting in ineffective service. 
Therefore, in accordance with various embodiments of the invention, the virtual 
10 enclosure server instructs various virtualization ports to "trap" messages 

addressed to one or more virtual enclosure ports. In this manner, the power of 
additional virtualization ports within the SAN to handle messages is leveraged. 
Accordingly, a virtualization port may service a virtual enclosure even though the 
virtualization port is not bound to a virtual enclosure port. 

1 5 A "trapping" virtualization port is preferably an "external" node within the 

SAN rather than an internal node. In other words, the virtualization port should 
be directly connected to a host rather than indirectly connected via one or more 
other ports (e.g., standard or virtualization ports). This direct connection is 
particularly important since an internal node may receive a message or request 

20 from a host, but the internal node may not receive messages from the target that 
are directed to the host, since the same return path is not guaranteed. As a result, 
the virtualization port would not be able to complete this "communication loop," 
and therefore will not have knowledge of whether a host request has been 
serviced. 

25 One method of coordinating virtual enclosure binding and trapping 

functionality of virtualization ports in accordance with various embodiments of 
the invention is illustrated in FIG. 9. Steps performed at the virtual enclosure 
server are represented by vertical line 902, and steps performed at virtualization 
ports 1-3 are represented by vertical lines 904, 906, and 908, respectively. A DNS 

30 server and associated switch are represented by vertical lines 912 and 910, 

respectively. The DNS server 912 is often included in the switch 910. The virtual 
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enclosure server 902 may send various virtualization messages to various ports 
within the SAN to enable virtualization of storage within a SAN. For instance, as 
described above, a virtualization message may be a bind message or a trap 
message, which identifies the PWWN of a virtual enclosure port. The primary 
5 difference between a bind message and a trap message is that a bind message 
indicates that a FCID is to be dynamically assigned to a virtual enclosure port, 
while a trap message indicates that the FCID that has previously been assigned to 
another virtual enclosure port is to be obtained so that messages directed to that 
FCID may be trapped by the receiving port. As shown at 914, the virtual 

10 enclosure server sends a bind message 914 instructing the first virtualization port, 
virtualization portl 904, to handle all messages directed to the first virtual 
enclosure port, VEP1 that are received by the virtualization portl 904. Each 
virtual enclosure port such as VEP1 may be uniquely identified by its PWWN. A 
virtualization message such as a bind or trap message may further indicate that the 

15 receiving virtualization port is to obtain an address or identifier assigned to the 
virtual enclosure port. For instance, the virtualization message may indicate that 
the address or identifier is to be obtained from a DNS server, which may be 
specified or unspecified. 

Once the bind message is received, the virtualization portl 904 sends a 
20 FLOGI message to the switch 910 at 916 to establish a connection with the switch 
910. As described above, a FCID is dynamically assigned during login. Thus, the 
switch 910 assigns a FCID, FCID1, to the first virtualization port VEP1, which is 
provided to the DNS server 912 at 918, which then associates the virtual 
enclosure portl, VEP1 with the FCID FCID1. The switch 910 then sends an 
25 ACCEPT message at 920 indicating that the FCID1 is now associated by the DNS 
server 912 with the first virtual enclosure port, VEP1. In addition, as shown, the 
ACCEPT message provides the FCID that has been assigned to the virtualization 
port 904. A virtualization port keeps track of those virtual enclosure ports with 
which the virtualization port is bound or for which the virtualization port is 
30 responsible for trapping messages. In order to maintain this virtual enclosure port 
information, the virtualization port may then store the FCID, FCID1, in a 
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virtualization port table such as that described below with reference to FIG. 10. A 
DNS REGISTRY is also performed at 922 to inform the DNS server 912 that 
VEP1 understands the SCSI protocol. The DNS server then sends an ACCEPT 
message at 924. A virtualization response is then sent from the virtualization port 
5 at 926 to the virtual enclosure server indicating that the virtualization port is now 
configured to handle messages addressed to the virtual enclosure port of the 
virtual enclosure. In this example, the virtualization response indicates that the 
virtualization port is now bound to the virtual enclosure port. In addition, the 
FCID assigned to the virtual enclosure port VEP1 may also be provided to the 
10 virtual enclosure server so that the virtual enclosure server may assign the FCID 
to the virtual enclosure port. More specifically, the FCID may be provided in the 
virtualization response. In this manner, the virtual enclosure server obtains the 
FCIDs of SCSI target ports available to it. 

In addition to binding of virtual enclosure ports to virtualization ports 
15 within the SAN, the virtual enclosure server 902 may also establish trapping by 
additional virtualization ports within the SAN as described above. For instance, 
as shown at 928 a trap message indicating that the virtualization port2 906 is to 
handle messages addressed to an address or identifier assigned to a particular 
virtual enclosure port is sent. Since the virtual enclosure server 902 has obtained 
20 the FCID assigned to the virtual enclosure port, VEP1, it may be provided in the 
trap message. Alternatively, the FCID may be obtained from a DNS server, as 
will be described in this example. In this example, the virtualization port 906 is 
directed to handle messages addressed to the specified virtual enclosure port (e.g., 
VEP1) that are received by it. In other words, the virtualization port 906 is 
25 instructed to handle messages addressed to the address or identifier assigned to 
the virtual enclosure port. Similarly, a second trap message is sent at 930 to the 
virtualization port3 908 indicating that the virtualization port is to handle 
messages addressed to the first virtual enclosure port. 

When the virtualization port2 906 receives the trap message at 928, the 
30 virtualization port sends a GET_FCID message at 932 to the DNS server 912 to 
obtain the address or identifier assigned to the first virtual enclosure port, VEP1. 
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Once it receives the address or identifier at 934, it stores the address or identifier 
at 936. More specifically, it may update a table such as that described below with 
reference to FIG. 10. The virtualization port then sends a virtualization response 
at 938 to the host in response to the virtualization message. For instance, the 
5 virtualization response may indicate that the virtualization port has been 

successfully (or unsuccessfully) configured to handle messages addressed to the 
virtual enclosure port. The virtualization port may now trap messages addressed 
to the virtual enclosure port that are received by it as shown at 940. 

Similarly, when the virtualization port3 908 receives the trap message at 
10 930, the virtualization port sends a GET_FCID message at 942 to the DNS server 
912 to obtain the address or identifier assigned to the first virtual enclosure port, 
VEP1 . Once it receives the address or identifier at 944, it stores the address or 
identifier at 946. The virtualization port sends a virtualization response at 948 
indicating that the virtualization port has been successfully (or unsuccessfully) 
1 5 configured as a trapping port, and begins trapping messages directed to the 
virtualization port at 950. 

As described above, a port within a SAN such as a virtualization port may 
be configured to handle messages on behalf of multiple virtual enclosure ports. 
More specifically, a single virtualization port may be bound to multiple virtual 

20 enclosure ports as well as be configured as a trapping port for multiple virtual 

enclosure ports. FIG. 10 is a diagram illustrating an exemplary table that may be 
maintained by a virtualization port indicating FCIDs to be handled by the 
virtualization port in accordance with various embodiments of the invention. As 
shown, a virtualization port table 1000 may be maintained by a virtualization port 

25 to keep track of those virtual enclosure ports 1002 with which it is bound or for 
which it is configured to trap messages. For each virtual enclosure port 1002, it 
maintains the associated FCID. In this manner, the virtualization port may 
identify those FCIDs for which it is responsible. When a packet is directed to an 
FCID for which the virtualization port is not responsible, it merely forwards the 

30 packet. 
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Once one or more visualization ports are configured to handle packets on 
behalf of a virtual enclosure port (e.g., trapping or bound ports), they may serve as 
SCSI targets for an initiator such as a host. FIG. 1 1 is a transaction flow diagram 
illustrating one method of establishing communication between a host and one or 
5 more visualization ports (e.g., bound to one or more virtual enclosure ports, 
trapping ports) such that the host can access one or more LUNs in accordance 
with various embodiments of the invention. As shown, interactions between a 
host 1 102, switch 1 104, Domain Name System (DNS) server 1 106 and 
visualization port 1 108 are represented by corresponding labeled vertical lines. 

10 As shown, in order for a fibre channel node such as a host 1 102 to establish a 
logical connection to a fabric switch 1 104, it performs a fabric login (FLOGI) 
1110. As described above, fibre channel uses an address identifier, referred to as 
an FCID, which is dynamically assigned during login. Thus, the switch 1 104 
provides an FCID to the host 1 102 at 1112. Once the host been assigned a host 

1 5 FCID, the host may perform a DNS query of a DNS server 1 106 via a SCSI 
REPORT command, which requests the SCSI targets that are available, and 
therefore visible, to the host at block 1 1 14. More specifically, the DNS query 
determines those SCSI targets that are visible to the host FCID. The FCID of one 
or more virtual enclosure ports as potential target ports are then provided by the 

20 DNS server 1 106 to the host 1 102 at 1 116. 

Once the host has the FCIDs of those SCSI target ports available to it, it 
sends a fibre channel process login command to one or more of the available 
virtual enclosure SCSI target ports (identified by its FCID) at 1 1 18. As described 
above, although the packet is addressed to an FCID assigned to a virtual enclosure 

25 port, a virtualization port that is bound to the virtual enclosure port or is trapping 
on behalf of the virtual enclosure port may actually handle these packets. This 
process login implements a mapping layer, which "maps" fibre channel to SCSI. 
Once completed, the SCSI virtual enclosure target port(s) 1 108 send a fibre 
channel accept message at 1 120. Since Fibre channel is mapped to SCSI, the host 

30 can send SCSI commands to the SCSI target virtual enclosure port(s). 
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Now that the host 1 102 can send SCSI commands to the virtual enclosure 
port(s) 1 108, it performs a SCSI process login at 1 122 by sending a SCSI process 
login command to the SCSI target virtual enclosure port 1 108. The SCSI virtual 
enclosure port 1 108 then sends a SCSI accept command 1 124. Communication 
5 between the host and the SCSI target virtual enclosure port via the SCSI protocol 
is therefore established. For instance, the host may determine which LUNs are 
available to it, as well as read and write to those LUNs available to it. 

Since the host 1 102 knows which SCSI targets (and virtual enclosure 
ports) are available to it and can communicate with each of these ports, it can send 

10 a SCSI REPORT LUN command to the SCSI target virtual enclosure port(s) 1 108 
to determine those LUNs that are visible to the host FCID at 1 126. For instance, 
these LUNs may simply be those VLUNs within the virtual enclosure, or may be a 
subset of those VLUNs. More specifically, this REPORT message may be sent to 
the FCIDs assigned to the virtual enclosure ports. The receiving SCSI target 

1 5 virtual enclosure port 1 108 determines which LUNs are visible to the host FCID 
at 1 128 and sends a reply message indicating one or more available LUNs (e.g., 
PLUNs or VLUNs) at 1 130. It is important to note that the receiving virtual 
enclosure port may actually be a virtualization port that is either bound to or 
trapping on behalf of a virtual enclosure port. Thus, these virtualization ports are 

20 also responsible for performing LUN mapping at 1 128. One method of LUN 

mapping will be described in further detail below with reference to FIG. 12. The 
host 1 102 may then send SCSI READ and WRITE commands to a particular 
VLUN at 1 132 via the virtual enclosure port 1 108. 

Virtualization messages such as trap and bind messages may be 
25 implemented in any communication protocol. The protocol that is implemented is 
preferably a reliable communication protocol, such as TCP sockets or Dynamic 
Instantiation Protocol (DIP), which runs on top of TCP/IP. 

FIG. 12 is a diagram illustrating an exemplary LUN mapping table that 
may be used at step 1 128 of FIG. 1 1 to perform LUN mapping. As shown, a LUN 
30 mapping table 1200 may be used to identify for each initiator (e.g., host) 1202 
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those VLUNs 1204 of a virtual enclosure that are visible via one or more virtual 
enclosure ports 1206 (e.g., FCBDs) of the virtual enclosure. For instance, a 
specified logical unit 1208 such as LUN0 may be used to represent a boot disk. 
Since it may be desirable to provide a different boot disk for each host, the 
5 specified logical unit 1208 is associated with one or more VLUNs 1204 which are 
made available to the host 1202 via the specified virtual enclosure ports 1206. 
The virtual enclosure ports 1206 that are available to a particular host 1202 may 
be specified, or alternatively, a wildcard may be used to indicate that all virtual 
enclosure ports are available to the host. Thus, when a request for a specified 
10 logical unit 1208 is received from the host via one of the virtual enclosure ports, 
the VLUNs associated with the specified logical unit 1208 are employed to 
service the request. 

FIG. 13 represents a virtual enclosure corresponding to the LUN mapping 
table of FIG. 12. As shown, virtual enclosure 1302 represents four VLUNS, A 

15 1304, B 1306, C 1308, and D 1310. The virtual enclosure 1302 has two virtual 
enclosure ports, VEP1 1312 and VEP2 1314. As shown in FIG. 12, host HI sees 
LUN0 as VLUN A on any virtual enclosure port, host H2 sees LUN0 as VLUN B 
on any virtual enclosure port, host H3 sees LUN0 as VLUN C on any virtual 
enclosure port, host H4 sees LUN0 as VLUN D on virtual enclosure port 0 only, 

20 and host H5 sees LUN0 as VLUN C on virtual enclosure port 1 only. In this 
manner, the identity of the VLUNs is invisible to the host. Accordingly, the 
present invention provides an additional level of storage virtualization. 

The LUN mapping table is preferably maintained at a central location 
such as the virtual enclosure server. However, in accordance with one 

25 embodiment, the LUN mapping table is also be provided as well as periodically 
distributed to the appropriate network devices (e.g., virtualization ports) within 
the storage area network. For instance, the LUN mapping table may be 
distributed at host login to a virtual enclosure port. In other words, the 
virtualization port is provided a LUN map corresponding to the host that has 

30 logged in via the virtual enclosure server. 
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Although illustrative embodiments and applications of this invention are 
shown and described herein, many variations and modifications are possible 
which remain within the concept, scope, and spirit of the invention, and these 
variations would become clear to those of ordinary skill in the art after perusal of 
5 this application. For instance, the present invention is described as being applied 
to frames. However, it should be understood that the invention is not limited to 
such implementations, but instead would equally apply to packets as well. 
Moreover, the present invention would apply regardless of the context and system 
in which it is implemented. Thus, broadly speaking, the coordination of binding 
10 and trapping by multiple ports need not be performed using a virtual enclosure 
server as described above, but may be performed in an alternate manner. 

In addition, although an exemplary switch is described, the above- 
described embodiments may be implemented in a variety of network devices (e.g., 
servers) as well as in a variety of mediums. For instance, instructions and data for 
15 implementing the above-described invention may be stored on a disk drive, a hard 
drive, a floppy disk, a server computer, or a remotely networked computer. 
Accordingly, the present embodiments are to be considered as illustrative and not 
restrictive, and the invention is not to be limited to the details given herein, but 
may be modified within the scope and equivalents of the appended claims. 
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CLAIMS 

What is claimed is: 

1 . A method of implementing storage virtualization in a storage area 
network, the method comprising: 

creating a virtual enclosure, the virtual enclosure having one or more 
virtual enclosure ports and being adapted for representing one or more virtual 
storage units, each of the virtual storage units representing one or more physical 
storage locations on one or more physical storage units of the storage area 
network; 

associating each of the virtual enclosure ports of the virtual enclosure with 
a port of a network device within the storage area network; and 

assigning an address or identifier to each of the virtual enclosure ports. 

2. The method as recited in claim 1, wherein associating each of the virtual 
enclosure ports of the virtual enclosure with a port of a network device within the 
storage area network comprises: 

instructing a port of a network device within the storage area network to 
handle messages addressed to the address or identifier assigned to the associated 
virtual enclosure port. 

3. The method as recited in claim 1, wherein associating each of the virtual 
enclosure ports of the virtual enclosure with a port of a network device within the 
storage area network comprises: 

instructing a port of a network device within a virtual SAN to handle 
messages addressed to the address or identifier assigned to the associated virtual 
enclosure port. 

4. The method as recited in claim 1, further comprising: 
associating a Node World Wide Name with the virtual enclosure. 
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5. The method as recited in claim 4, further comprising: 

assigning a Port World Wide Name to each of the virtual enclosure ports 
such that the Port World Wide Name is associated with an associated port of a 
network device within the storage area network. 

6. The method as recited in claim 1, wherein the port of the network device 
within the storage area network is a port of a fibre channel device. 

7. The method as recited in claim 1, wherein assigning an address or 
identifier to each of the virtual enclosure ports comprises: 

assigning a FCED to each of the virtual enclosure ports. 

8. The method as recited in claim 1, further comprising: 

selecting a number of virtual enclosure ports of the virtual enclosure. 

9. The method as recited in claim 8, wherein the number of virtual enclosure 
ports of the virtual enclosure is greater than a number of ports of each network 
device within the storage area network. 

10. The method as recited in claim 1, wherein associating each of the virtual 
enclosure ports of the virtual enclosure with a port of a network device within the 
storage area network comprises: 

associating the virtual enclosure ports with ports of one or more network 
devices within the storage area network. 

11. The method as recited in claim 1, wherein associating each of the virtual 
enclosure ports of the virtual enclosure with a port of a network device within the 
storage area network comprises: 

binding a port of a network device within the storage area network to one 
or more of the virtual enclosure ports. 

1 2. The method as recited in claim 11, further comprising: 

instructing one or more additional ports of one or more network devices 
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within the storage area network to trap messages directed to one of the virtual 
enclosure ports. 

13. The method as recited in claim 1, wherein one or more of the virtual 
storage units each comprises a VLUN or other virtual representation of storage on 
the storage area network. 

14. The method as recited in claim 1, further comprising: 
assigning one or more virtual storage units to the virtual enclosure. 

15. The method as recited in claim 14, wherein the one or more virtual storage 
units each comprise a VLUN or other virtual representation of storage on the 
storage area network. 

16. A computer-readable medium storing thereon computer-readable 
instructions for implementing storage virtualization in a storage area network, 
comprising: 

instructions for creating a virtual enclosure, the virtual enclosure having 
one or more virtual enclosure ports and adapted for representing one or more 
virtual storage units, each of the virtual storage units representing one or more 
physical storage locations on one or more physical storage units of the storage 
area network; 

instructions for associating each of the virtual enclosure ports of the 
virtual enclosure with a port of a network device within the storage area network; 
and 

instructions for assigning an address or identifier to each of the virtual 
enclosure ports. 

17. An apparatus for implementing storage virtualization in a storage area 
network, comprising: 

means for creating a virtual enclosure, the virtual enclosure having one or 
more virtual enclosure ports and adapted for representing one or more virtual 
storage units, each of the virtual storage units representing one or more physical 
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storage locations on one or more physical storage units of the storage area 
network; 

means for associating each of the virtual enclosure ports of the virtual 
enclosure with a port of a network device within the storage area network; and 

means for assigning an address or identifier to each of the virtual 
enclosure ports. 

18. A network device adapted for implementing storage virtualization in a 
storage area network, comprising: 

a processor; and 

a memory, at least one of the processor and the memory being adapted for: 

creating a virtual enclosure, the virtual enclosure having one or more 
virtual enclosure ports and adapted for representing one or more virtual storage 
units, each of the virtual storage units representing one or more physical storage 
locations on one or more physical storage units of the storage area network; 

associating each of the virtual enclosure ports of the virtual enclosure with 
a port of a network device within the storage area network; and 

assigning an address or identifier to each of the virtual enclosure ports. 

19. A method of performing LUN mapping in a storage area network, the 
method comprising: 

accessing a LUN mapping table having one or more entries, each of the 
entries identifying an initiator in the storage area network, one or more of a set of 
one or more virtual enclosure ports of a virtual enclosure, and associating a 
specified logical unit with one or more virtual storage units, each of the virtual 
storage units representing one or more physical storage locations on one or more 
physical storage units of the storage area network, wherein the virtual enclosure is 
adapted for representing the set of one or more virtual storage units and each of 
the virtual enclosure ports is associated with a port of a network device within the 
storage area network; and 

when a request for the specified logical unit is received from the initiator 
via one of the associated virtual enclosure ports, identifying one of the entries in 
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the LUN mapping table and employing the one or more virtual storage units 
specified in the entry to service the request. 

20. A computer-readable medium storing thereon instructions for performing 
LUN mapping in a storage area network, comprising: 

instructions for accessing a LUN mapping table having one or more 
entries, each of the entries identifying an initiator in the storage area network, one 
or more of a set of one or more virtual enclosure ports of a virtual enclosure, and 
associating a specified logical unit with one or more virtual storage units, each of 
the virtual storage units representing one or more physical storage locations on 
one or more physical storage units of the storage area network, wherein the virtual 
enclosure is adapted for representing the set of one or more virtual storage units 
and each of the virtual enclosure ports is associated with a port of a network 
device within the storage area network; and 

instructions for identifying one of the entries in the LUN mapping table 
and employing the one or more virtual storage units specified in the entry to 
service the request when a request for the specified logical unit is received from 
the initiator via one of the associated virtual enclosure ports. 

21. A method of implementing storage virtualization in a storage area 
network, the method comprising: 

sending a virtualization message to a port of a network device within the 
storage area network, the virtualization message instructing the port to handle 
messages addressed to a virtual enclosure port of a virtual enclosure, the virtual 
enclosure having one or more virtual enclosure ports and being adapted for 
representing one or more virtual storage units, each of the virtual storage units 
representing one or more physical storage locations on one or more physical 
storage units of the storage area network; and 

receiving a virtualization response from the port of the network device in 
response to the virtualization message. 

22. The method as recited in claim 21, wherein the virtual enclosure port is 
identified by a NWWN and a PWWN. 
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23. The method as recited in claim 21, wherein the virtualization response 
indicates that the port is configured to handle messages addressed to the virtual 
enclosure port of the virtual enclosure. 

24. The method as recited in claim 21, wherein the virtualization message 
indicates that the port is to obtain an address or identifier assigned to the virtual 
enclosure port. 

25. The method as recited in claim 24, wherein the virtualization message is a 
bind message or a trap message. 

26. The method as recited in claim 24, wherein the virtualization response 
comprises the address or identifier assigned to the virtual enclosure port. 

27. The method as recited in claim 21, wherein the virtualization message 
indicates that the port is to obtain an address or identifier assigned to the virtual 
enclosure port from a DNS server. 

28. The method as recited in claim 24, further comprising: 

receiving the address or identifier assigned to the virtual enclosure port. 

29. The method as recited in claim 24, wherein the address or identifier is an 
FCED. 

30. The method as recited in claim 21, wherein the virtualization message 
indicates that the port is to handle messages addressed to an address or identifier 
assigned to the virtual enclosure port. 

3 1 . The method as recited in claim 30, wherein the address or identifier is an 
FCID. 

32. A computer-readable medium storing thereon computer-readable 
instructions for implementing storage virtualization in a storage area network, 
comprising: 
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instructions for sending a virtualization message to a port of a network 
device within the storage area network, the virtualization message instructing the 
port to handle messages addressed to a virtual enclosure port of a virtual 
enclosure, the virtual enclosure having one or more virtual enclosure ports and 
being adapted for representing one or more virtual storage units, each of the 
virtual storage units representing one or more physical storage locations on one or 
more physical storage units of the storage area network; and 

instructions for receiving a virtualization response from the port of the 
network device in response to the virtualization message. 

33. An apparatus adapted for implementing storage virtualization in a storage 
area network, comprising: 

means for sending a virtualization message to a port of a network device 
within the storage area network, the virtualization message instructing the port to 
handle messages addressed to a virtual enclosure port of a virtual enclosure, the 
virtual enclosure having one or more virtual enclosure ports and being adapted for 
representing one or more virtual storage units, each of the virtual storage units 
representing one or more physical storage locations on one or more physical 
storage units of the storage area network; and 

means for receiving a virtualization response from the port of the network 
device in response to the virtualization message. 

34. An apparatus adapted for implementing storage virtualization in a storage 
area network, comprising: 

a processor; and 

a memory, at least one of the processor and the memory being adapted for: 
sending a virtualization message to a port of a network device within the 
storage area network, the virtualization message instructing the port to handle 
messages addressed to a virtual enclosure port of a virtual enclosure, the virtual 
enclosure having one or more virtual enclosure ports and being adapted for 
representing one or more virtual storage units, each of the virtual storage units 



-41 - 



WO 03/060688 



PCT/US02/41079 



representing one or more physical storage locations on one or more physical 
storage units of the storage area network; and 

receiving a virtualization response from the port of the network device in 
response to the virtualization message. 

35. A method of implementing storage virtualization in a storage area 
network, the method comprising: 

receiving a virtualization message at a port of a network device within the 
storage area network, the virtualization message instructing the port to handle 
messages addressed to a virtual enclosure port of a virtual enclosure, the virtual 
enclosure having one or more virtual enclosure ports and being adapted for 
representing one or more virtual storage units, each of the virtual storage units 
representing one or more physical storage locations on one or more physical 
storage units of the storage area network; and 

sending a virtualization response from the port of the network device in 
response to the virtualization message. 

36. The method as recited in claim 35, wherein the virtualization message 
indicates that the port is to obtain an address or identifier assigned to the virtual 
enclosure port, the method further comprising: 

obtaining the address or identifier assigned to the virtual enclosure port. 

37. The method as recited in claim 36, further comprising: 
storing the address or identifier. 

38. The method as recited in claim 35, wherein the virtualization message 
indicates that the port is to obtain an address or identifier assigned to the virtual 
enclosure port from a DNS server, the method further comprising: 

obtaining the address or identifier assigned to the virtual enclosure port. 

39. The method as recited in claim 36, further comprising: 

sending the address or identifier assigned to the virtual enclosure port. 
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40. The method as recited in claim 36, wherein the address or identifier is an 
FCID. 

41 . The method as recited in claim 35, wherein the virtualization message 
indicates that the port is to handle messages addressed to an address or identifier 
assigned to the virtual enclosure port. 

42. The method as recited in claim 41, wherein the address or identifier is an 

fcid. 

43. The method as recited in claim 41, further comprising: 

handling messages addressed to the address or identifier assigned to the 
virtual enclosure port. 

44. The method as recited in claim 35, further comprising: 

handling messages addressed to the virtual enclosure port of the virtual 
enclosure. 

45. The method as recited in claim 36, further comprising: 

handling messages addressed to the address or identifier assigned to the 
virtual enclosure port. 

46. The method as recited in claim 35, further comprising: 

receiving a report message requesting an identification of one or more of 
the virtual storage units supported by an address or identifier assigned to one of 
the virtual 

enclosure ports; 

sending a reply message identifying one or more of the virtual storage 

units. 

47. The method as recited in claim 46, wherein the address or identifier is an 
FCED. 
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48. The method as recited in claim 46, wherein one or more of the virtual 
storage units comprises a VLUN or other virtual representation of storage on the 
storage area network. 

49. The method as recited in claim 46, wherein the one or more of the virtual 
storage units identified in the reply message are those virtual storage units that are 
visible to an initiator sending the report message. 

50. A computer-readable medium storing thereon computer readable 
instructions for implementing storage virtualization in a storage area network, 
comprising: 

instructions for receiving a virtualization message at a port of a network 
device within the storage area network, the virtualization message instructing the 
port to handle messages addressed to a virtual enclosure port of a virtual 
enclosure, the virtual enclosure having one or more virtual enclosure ports and 
being adapted for representing one or more virtual storage units, each of the 
virtual storage units representing one or more physical storage locations on one or 
more physical storage units of the storage area network; and 

instructions sending a virtualization response from the port of the network 
device in response to the virtualization message. 

51. A network device adapted for implementing storage virtualization in a 
storage area network, comprising: 

means for receiving a virtualization message at a port of a network device 
within the storage area network, the virtualization message instructing the port to 
handle messages addressed to a virtual enclosure port of a virtual enclosure, the 
virtual enclosure having one or more virtual enclosure ports and being adapted for 
representing one or more virtual storage units, each of the virtual storage units 
representing one or more physical storage locations on one or more physical 
storage units of the storage area network; and 

means for sending a virtualization response from the port of the network 
device in response to the virtualization message. 
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52. A network device adapted for implementing storage virtualization in a 
storage area network, comprising: 
a processor; and 

a memory, at least one of the processor and the memory being adapted for: 
receiving a virtualization message at a port of a network device within the 
storage area network, the virtualization message instructing the port to handle 
messages addressed to a virtual enclosure port of a virtual enclosure, the virtual 
enclosure having one or more virtual enclosure ports and being adapted for 
representing one or more virtual storage units, each of the virtual storage units 
representing one or more physical storage locations on one or more physical 
storage units of the storage area network; and 

sending a virtualization response from the port of the network device in 
response to the virtualization message. 
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